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ABSTRACT 

The Using Evaluation Data Form (UEDF) represents a 
psychological lever for getting a program 1 s decision maker to 
consider malor evaluation findings. The form may be used at any point 
of the evaluation process when sufficient data exist to support a 
finding deserving of action or reaction by the project staff. By 
local policy r it is required for inclusion in all end-cf-year , 
evaluation reports. Findings are results of evaluation activities 
conducted throughout the year. The process of the form f s use is 
initiated when the e valuator lists f in draft form, findings the 
evaluator desires to be considered for possible action by the project * 
manager. Findings are reported descriptively rather than 
'judgment ally. In most instances r the evaluator will discuss these 
findings with the project manager. Each finding is addressed by the 
manager r indicating the action taken r cr to be taken. Justification 
for no action or action contrary to the findings r must fce explained,. 
The "Action" column represents the project manager 1 s reply to the 
evaluation findings. An example fora is attached for review* The form 
is effective to the extent that the system requires the* program 
people be committed to a course of actiou in response tc evaluation 
data. (Author) 
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The Using Evaluation Data Form (UEDF) is not much more than a blank piece of 
paper, taken of itself. However, the form represents a psychological lever 
for getting a program's decision maker to consider major evaluation findings. 
The form may be used at any point of the evaluation process when sufficient 
data exists to support a finding deserving of action or reaction by the 
project staff. By local policy, it is required for inclusion in all end-of- 
year evaluation reports* Findings are results of evaluation activities 
conducted throughout the year. 

The process of the form's use is initiated when the evaluator lists, in draft 
form, findings the evaJ.uator desires to be considered for possible action by 
the project manager. Findings are reported in descriptive rather than judg- 
mental terms. In most instances, the evaluator will discuss these findings 
with the project manager. Each finding is addressed by the manager, indicating 
the action already taken, or to be taken. Justification for no action or action 
contrary to the findings, must be explained. In brief, the "Action" column 
represents the project ^manager's reply to the evaluation findings. , An example 
form is attached for review. 

What is so ingenious about this process? Not a lot really. The form is 
effective to the extent that the system requires the program people to commit 
themselves to a course of action in response to evaluation data. The evaluator 
then acts as a change agent. The insurance part of the procedure is that the 
UEDF is maintained for the duration of the program. Commitment to action 
becomes an addendum to the original evaluation plan. 

Probably the greatest feature of the UEDF is the interaction between project 
staff and evaluator which results, particularly after both parties become 
familiar and relaxed with its use. If, when the objectives of the program 
are being drafted, an objective can be included which references the use 
of the UEDF in program revision, the program will have a built-in assurance 
for the use of the process. 

The UEDF is part of the executive summary of evaluation final reports. An 
executive summary is provided for review (APPENDIX A). UEDF pages selected 
from 50 evaluations carried out this year are attached to illustrate variations 
on the form's use (APPENDIX B). Other documents on our philosophy of data 
utilization are available upon request. 

Using evaluation data continues to be a priority of our office. At this 
writing, we are considering several alternative ways of documenting use. 
Any suggestions or effective ways you have found to document use of informa- 
tion would be appreciated. 
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MATH ATTITUDES PROJECT 

SUMMARY OF EVALUATION ON THE ACCOMPLISHMENT OF 
OBJECTIVES FOR THE MATH ATTITUDE PROJECT 

Tha purpose of the Math Attitude Project was to provide inservice training and 

training came to consist of presenting theory and specific activates chat 
eonTT naJ ° r areaS ° f Mth ^truction. These areas were 1) use of 

concrete objects to teach math concepts, (2) ways of teaching the problem 

wavT^ pr0c ?"». (j ' wa >' s t0 im P rove student attitudes toward math, and (A) 

a«~f«ii« ""V^T", 1,,C uumoer or "acners trained from each district were 
;^ t f °c^;.i!. th ?:?? ^diocese (13), South San Antoni, (9), Devine ( 3 S). 

~ M ° UJ » tw " Ui), ixorcneasc u), Judson (75) East fpm-rpl (f>\ ^ 

Springs (12), Hondo (12), Medina Valley (26) , and ' Sa b na ( £i X 

Saturdav: "T \° ^ districts > ™» were scheduled after school or"n 

Saturdays. Each teacher received a total of about 10 hours of training As 

thill* °M u Pr ° j ! Ct ' 6aCh teach6r W£S t0 devel °P tw ° activities that will be 

StH IV C fu^di^ YT^ Ch6rS - ThiS pr ° ject is in its first year of 
Title IV-C funding, and the funding for this year was approximately 567,000. 

Each objective of the project proposal was evaluated by the ESC-20 Evaluation 
Services Component. All of the evaluation memorandum and reports written 

are attached 6 " ^ by the ° bjeCtiVe " Which ^ PertaJn and 

The major findings are as follows: 

^^ tlve ™ iS °bjective called for development of an inservice program 

that included objectives, activities, pre/posttests , and instruc- 
tional resources. Such a program was developed. Final review 
of the objectives indicated that all of them met the criteria 
stated on the Objective Checklist . 

Objective 2.0: This objective called for 200 teachers to be trained in the com- 
ponents of effective math instruction. At least 70% were to 
demonstrate mastery on the training posttest. A total of seven 
Ja * v " ,u ' 1 posttests or exercises were given to the 210 parti- 
cipants trained. The test on which the highest percentage 
demonstrated mastery was the exercise on Attitudes in Math (96%) 
The test on which the lowest percentage of teachers demonstrated 
mastery was the exercise on Reading in Math (73%). The average 
.or the seven tests was 84% demonstrating mastery. 

ijP jeCtive 3 -° : Thi * objective called for 50% of the teachers to implement the 
training provided on math instruction. Focused interviews were 
conducted with a sample of teachers in the project. Based cn the 
criteria developed for the project, a total of 76% of the sample 
was found to be implement: ;s . 

Objectiye_^0: This objective called for 75% of the teachers receiving technical 
assistance from project staff to consider that assistance to be 
helpful. From interviews conducted with a sample of teachers it 
was found that 63% believed the on-site assistance to be helpful. 

The following Using Evaluation Data Form provides more detailed information on 
the project and, for each finding presents the modifications in the project 
tnat nave already been made or that are planned for next year. 
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CURRICULUM AND SPECIAL PROJECTS 
MATH ATTITUDE PROJECT 

USING EVALUATION DATA 



FINDINGS 



WORKSHOPS 



C. 



The participants saw the strengths of the workshops as 
being the multitude of ideas presented by project staff 
and the opportunity for teachers to share with one 
another. 



One of the weaknesses of the workshops was that both the 
primary (grades 1-3) and intermediate (grades 4-6) tea- 
chers believed that the workshops should focus more on the 
needs of their particular grade level. Several suggested 
separate workshops for primary and intermediate. 



According to the participants, the other weaknesses of tie 
workshops related to different elements of time. They 
were as follows. 

(1) Too much time was spent on theory. 

(2) Workshop should not be scheduled after school. 

(3) Too little time was available to make materials. 



ACTION 



The project staff will continue to offer as many dif fere 
ideas as possible to the teachers. The amount of group 
work among teachers will be increased. This will includ< 
meeting in groups to discuss ideas and suggestions for a< 
vities and to work through specific skills presented in i 
workshop. 

When the participants are divided into groups, the group* 
will be based more on the primary-intermediate classifies 
tion. Since more group work is planned for next year, tc 
chers will have more of an opportunity to work with othei 
of their same classification. Also, a file of activiitei 
will be available to the participants. This file will be 
organized by grade level so that participants will be ab: 
to identify activities that fit the needs of their partic 
lar grade. 



(1) 



(2) 



Action means concrete policy, procedures, decisions, or assignments. 
"No action" may be justified but should be explained for the record. 



Much of the needed theory is now being sent to the 
participants before the workshop. In this way, the) 
can review it beforehand, and less workshop time is 
taken up covering this material. 

A number of workshops are being scheduled during the 
summer. The project staff will also continue to tr> 
scheduling workshops on inservice days. However, ir 
compliance with requests from school districts, wort 
shops will not be scheduled during school hours, anc 
thus some after school sessions will probably still 
necessary. 



USING EVALUATION DATA 



FINDir^GS 



ACTION 



TEACHER IMPLEMENTATION 

D. The workshops presented information on four major areas 
of math instruction (Concrete Activities, Troblem Solv- 
ing, Reading in Math, Student Attitudes to Math). By 
interviewing the teachers, it was found that many parti- 
cipants used the information on two of the areas, but 
feu used the information on the other two. The speci- 
fics are presented below. 



(1) The teachers were most likely to modify their in- 
struction in the area of using Concrete Activities 
They did so by using the specific materials pre- 
sented in the workshop, such as the grid for multi- 
plication and the place value mat. However, few 
teachers appeared to have incorporated the 
Concrete-Pictorial-Abstract continuum into their 
instruction. 



(3) Make-and Take sessions, where teachers have tue opp« 
tunity to make classroom materials, will be held ag* 
next year, but, given the limited amount of workshop 
time (10 hours total) and the amount of material to 
covered, it appears that little of this time can be 
allocated to making materials. 



The project staff is planning a reorganization of the wor 
shop to addresj the issues listed in the findings. In 
general, this reorganization consisits of identifying whi 
areas of instruction are of higbdst priority and adjustin 
the emphasis of the presentation to insure that sufficien 
time is available to adequately cover ttu&*e areas. Since 
the amount of workshop time is lmited, lower priority ar 
will receive less emphasis and time, (It should be noted 
that this reorganization has already been piloted during 
a workshop held in June). 



(1) 



The project staff will continue to present a number 
of specific materials on Concrete Activiites. More 
workshop time will be dedicated to the Concrete to 
Abstract continuum. This time will be used by the 
project staff to present and model more activities 
that emphasize the continuum, it will also be used 
to allow group discussion on the continuum activi- 
ties developed and piloted by participants. 



Action means concrete policy, procedures, decisions, or assignments, 
"No action" may be justified but should be explained for the record. 



9 

ERLC 



9 



USING EVALUATION DATA 



(2) 



(3) 



(4) 



FINDINGS 



The majority of teachers modified their instruction 
in the area of Student Attitudes. They did so pri- 
marily by using the information on real life math. 
Only half as many teachers used the information on 
using reward to improve student attitudes toward 
math. 

The teachers were least likely to make changes in 
the area of Problem Solving. The major reasons f jr 
this were: 

(3a) Fewer specific activities on Problem Solving 
were presented in the workshop. The teachers 
appeared to have difficulty in taking the 
theory and concepts presented and, on their 
own, translating them into classroom activities 

(3b) Some teachers indicated that they did not 

apply t v » information on problem solving he- 
cause the reading level of their students was 
too low to make it appropriate to emphasize 
"word problems." 



Less than half of the teachers were using the in- 
formation in the area of Reading in Math, which 
covered instructional strategies for math vocabu- 
lary and symbols. 



(2) 



(4) 



Action means concrete policy, procedures, decisions, or assignments. 
"No action" may be justified but should be explained for the record. 



ACTION 



Since teachers appear to be able to quickly incorporat 
real life into their instruction, this aspect will now 
be covered by just presenting examples. Less emphasis 
will be placed on using reward. 



(3a) More workshop time will be dedicated to the area • 
Problem Solving- This time will be used to presei 
additional specific activities on problem solving 
Also, time will be spent on the project staff 
modeling problem solving activities on group dis- 
cussions of problem solving activities developed 
and piloted by the teachers. 



(3b) The project staff has a goal to show teachers that 
problem solving is more than just "word problems. 1 
They intend to do so by showing teachers how to 
create problem solving situations which students 
can act out or draw, and where no reading is 
required. In addition to these activities which 
are supplements to the textbook problems, the 
teachers will be shown how to simplify the reading 
required for textbook problems. 

Less emphasis will be placed on Reading in Math, but 
some of it will still be presented by incorporating 
part of it into Concrete Activities and part into 
Problem Solving. 
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USING EVALUATION DATA 



FINDINGS 



FOLLOW-UP ASSISTANCE 



E. 



The two aspects of the follow-up assistance that the tea- 
chers most appreciated were as follows. 



(1) 



(2) 



They usually liked the consultant making an on-site 
visit to demonstrate with the students some pro- 
cedure or activity. 



It appeared ch«t many of the teachers were somewhat 
isolated in that they received little feedback as to 
the quality of their instruction. Through both the 
workshops and the follow-up assistance, the teacher 
had a knowledgeable person, the consultant, to tell 
them whea they had been doing good things . This 
reassured the teachers and made them more confident 
in their mat v instruction. 



About one-third of the teachers were not interested in 
follow-up assistance. When on-site visits were made to 
these teachers, they saw it as taking up their time to 
help the consultant find out what was going on in the 
schools. Thus, for these teachers, the visits were seen 
as benefit to the consultant but not to the teacher. 



ACTION 



E. 



(1) The project staff will continue to make teachers awai 
that they are available to come to the schools to mal< 
such demonstrations. To remind teachers of this, a 
newsletter will be sent out to participants next yeai 



(2) 



The project staff will continue to try to recemize 
and praise the good work being done by teachers. 
Since providing feedback is an essential role of con- 
sultants, the project evaluator will share this findi 
with other instructional consultants in the fall. Th 
will be done at a curriculum staff meeting and the 
purposes will be to insure that all consultant* 
especially new ones, are aware of this role to iden- 
tify ways that consultants can be more effective in 
this role. 



This year, the teachers were asked to complete a f-rm indi 
eating when they wanted an on-site visit, but not if they 
wanted an on-site visit. Next year, the form will be 
changed to ask teachers if they want a visit, when would 
be the best time, and what assistance they would like the 
consultant to provide. 



Action means concrete policy, procedures, decisions, or assignments. 
"No action" may be justified but should be explained for the record. 
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APPENDIX B 

Example: Modify Program 

Example: Accountability 

Curriculum Example: Project Materials 

Curriculum Example: Teacher Training 

Example: Future Direction 
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EXAMPLE: MODIFY PROGRAM 



USING EVALUATION MA 



FINDINGS 



ACTION 



PROGRAM OBJECTIVES 

The percentage of General Educational Development (GED) 
Adult Basic Education (ABE) and English as a Second 
Language (ESL) students completing one or more grades 
or levels, the percentage of GED students receiving 
GED certificates, and the percentage of Adult Perform- 
ance Level (APL) students receiving a high school 
diploma differed from program objectives. 



Program Component 

Completions 
JPED 
ABE 
ESL 

Certificates & Diplomas 
GED (certificate) 
APL (diploma) 



1978-79 
Objective 



50% 
35% 
40% 



1978-79 
Data 



43% 
41% 
32% 



50% 
25% 



20% 
39% 



The findings on the accomplishment of 1979-80 program 
objectives were that some objectives v/ere substan- 
tially accomplished, some partially accomplished, and 
some not accomplished to any appreciable degree. 
Conversations with program staff established that 
there was insufficient time and data to set reasonable 
objectives for 1979-80. 



Based on these data reported in December of 1979, 
program staff revised 1979-80 program objectives and 
rewrote 1980-81 objectives. 



Revised Objectives for 1979-80 and 1980-81 



60% 
40% 
35% 



20% 
40% 



The Coordinating Committee and ESC-20 staff reviewed the 
needs assessment data and other pertinent informatioa, 
including their experience running similar programs. 
Priorities were set and the number of objectives set 
was reduced from 12 (1979-80) to five (1980-81) — a 
more manageable number. Objectives set were measurable 
and reflected important needs identified. 



Action means concrete policy, procedures, decisions, or assignments. 
"No action" may be justified but should be explained for the record 
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EXAMPLE: MODIFY PROGRAM 



USING EVALUATION DATA 



RIDINGS 



c. 



D. 



Based on 64 referrals (October through April) the 
tollowing table documents where those seeking 
services learned about the program. 

Percentage Source of Referral 

42% Local or State Agency 

39% ' Social Service or Medical Agencies 

2% Media (radio, T.V., newspapers, 

brochures) 

17% Other 

Site visits and interviews conducted at the Light- 
house for the Blind and the ESC-20 Instructional 
Media Center document a need for program staff to 
provide more on-site support training. However, 
at the Holiday Inn, where the work trainer is 
present du^'ng the student's training sessions, 
the need fo/ additional support training was not, , 
indicated. J, 

"J 



ACTION 



Few learned about the program from media. To improve 
this situation, project staff will continue to seek 
television and newspaper coverage, A new brochure 
has been printed in English and Spanish for distribu- 
tion at public awareness meetings. 



Given supplemental funding, additional community 
training sites will be established with on-site 
work trainers. Trainers monitor job training and 
progress of students. 



ERLC 
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Action means concrete policy, procedures, decisions, or assignments 
"No action^ may be justified but should be explained for the record, 
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EXAMPLE: ACCOUNTABILITY 

USING EVALUATION MTA 



FINDINGS 



IMPACT ON STUDENTS 
(Vocational KdurnMon) 

We estimate extensive improvement in instructional pro- 
gramming for one-third of the students served. The case 
reports document a substantial pervasive change in these 
students* instructional program winch will better meet 
their post-schooling needs, uWe found quite modest 
benefits to another one-third of the students and neg- 
ligible effects in the last third. These findings were 
based on interviews covering the use of vocational eval- 
uation reports for a representative group of students. 



The benefit to students is limited by factors external 
to the Vocati nal Evaluation Center. These include, but 
are not limited to, existing personnel and programs <tt 
the district ie d, the attitudes and behaviors of stu- 
dents , and t he s t ud en t s 1 f am i 1 y sic ua t i on . 



ACTION 



The findings suggest the project worked well. How- 
ever, to increase the percentage of cases with ex- 
tensive improvement in instructional programming 
t wo actions are b e i ng t a ken . Th t* Intake Jo i m w 1 1 1 
require the name of vocational personnel to whom a 
copy of appropriate reports can be sent. This will 
increase the number of advocates for appropriate 
programming. Also, referrals will onlv bo taken 
from districts with adequate knowledge of the 
students 1 prevocational skills, thus increasing 
the likelihood of impacting students. 

Project Staff will be concentrating on district 
factors they can affect. A t hree-pi onged approach 
is planned. First, project staff will be attempting 
to upgrade the skills of district personnel by teach- 
ing them prevocational screening (Level 1 assessments) 
and certain w^rk sample assessments. Second, project 
staff will be focusing project activities to some 
extent on districts having resources to utilize 
vocational evaluations or having the interest to 
sain these skills. Third, project staff will be 
attending more Admission Review Dismissal Committees 
where they will promote appropriate use of reports. 
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Action means concrete policy, procedures, deeisums, or assignments. 
"No action" may be justified but sh -uld be explained for the record. 
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EXAMPLE: ACCOUNTABILITY 

USING EVALUATION DATA 



FIfCINGS 



HOURS OF SERVICE 
(Special Education) 

During the 33 working weeks of the period from July 
through March, Evaluation Services monitored cumulative 
hours of service, average weekly hours of service, and 
numbers of infants served. This information was reported 
on a quarterly bat is to the infant-parent trainer. T ,v 
March, project staff had provided a total of 383. 4 hours 
of service to twenty infants (for an average of 11.6 
hrs/wk of service). 



HOURS OF TRAINING PROVIDED INDIVIDUAL 
(Special Education) 



INFANTS 



Regularly scU 'lied service (1.2 to 1.9 hrs/wk) was 
provided to si- infants who were members of the infant- 
parent trainer's regular client load. The three infants 
who received less than the criterion of 1.5 hrs/wk of 
training often missed oppointments because of illness, 
hospitalization, or family business. The infant-parent 
trainer observed that the infants who received the high- 
est levels of service were those whose parents seldom 
broke appointments and were always careful to reschedule 
missed appointments. 



ACTION 



The inf ent-par ent trainer continually monitored 
hours ot training provided. As a result, the 
hours of service provided this year increased to 
13.6 hrs/wk from the t.verage of 6.2 hrs/wl provided 
last vear . 



The infant-parent trainer set the criterion for 
hours of service to be provided next year on tlu 
basis of thi.s year's data. She will continue to 
offer parents opportunities to reschedule missed 
appointments. 



Action means concrete policy, procedures, decisions, or assignments, 
"No action" <nay be justified but should be explained for the r u ord. 
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EXAMPLE: ACCOUNTABILITY 

USING EVALUATION LV\TA 



FILINGS 



stuhpnt r.^ouiH 
(Spec ial Education) 

One of the infants doubled her devel opmer. ta 1 rare, as 
measured by the Learning Acconpl ishment Profile; another 
made a definite increase in developmental level b»'l not 
rate; and the four remaining infants were able to maintain 
their developmental levels. Because there is no compari- 
son sample for this population of infants, it is diffi- 
cult to determine how these students should perform on 
the Learning Accomplishment Pro! ile; expectations that 
were clearly appropriate for visually handicapped infants 
don't seem to be appropriate for deaf-blind infants. 



ACTION 



Because the program will be funded through a dif- 
ferent funding source next year, funds for evaluation 
will not be available. Therefore, the infant-parent 
trainer will attempt to find an appropriate assessment 
of progress for these infants. She will investigate 
instruments that may better reflect small amounts of 
growth at lower developmental levels; instruments 
that may be considered are the 'revised Learning Ac- 
complishment Profile (LAP), the instrument developed 
by the El Paso Rehabilitation Center, and the instru- 
ment developed by the Meeting Street School in Rhode 
Island. She will supplement formal information on 
developmental growth with case notes and with ratings 
of progress documented by the Individualized Educa- 
tional Plan (IEP) — especially accomplishment of 
objectives related to limited, concrete goals (for 
example, reducing the amount 01 time an infant spends 
crying or the amount of time spent in feeding or 
bringing about a specific increase ij range of 
motion) . 
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Action means concrete policy, procedures, decisions, or assignments 
"No action" may be justified but should be explained for the record. 
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EXAMPLE: ACCOUNTABILITY 



USING EVALUATION DATA 



FILINGS 



PARENT INTERVIEWS 
(Special Educat ion) 

Nearly all of the five parents interviewed felt that 
working with the infant-parent trainer helped them to: 
(a) understand their child's handicap better; (b) know 
what they could do to improve their child's skills; 
(c) feel a greater sense of personal support and en- 
couragement . Parents found that the personal support 
offered by the infant-parent trainer and her resources 
of knowledge and experience were most valuable to them. 
They indicated that the greatest obstacle to follow- 
through on the infant-parent trainer's recommendations 
was a lack of time. 



PARENT ^RCEPTIONS OF INFANT PROGRESS 
(Special Education) 

All five parents interviewed indicated that the infant- 
parent training caused their children to demonstrate 
"major improvement in several areas" or "major improve- 
ment in many areas" ("4" or "5" on a 5-point scale). 
The major improvements they saw were: improved visual 
and auditory responsiveness, more independent explora- 
tion and play, and greater mobility. 



ACTION 



Because the benefits cited by parents match the 
infant-parent trainer's goals, she will continue 
to concentrate on these goals in working with 
parents. In order to relieve some of the pressures 
caused by a lack of time, the infant-parent trainer 
will try to define more clearly for parents what 
her expectations are. The infant-parent trainer 
also used some of the points raised in the interviews 
to initiate discussions with individual parents on 
points that appeared to concern them. 



No action is necessary. 
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Action means concrete policy, procedures, decisions, or assignments. 
"No action" may be justified hut should be explained for the record. 
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EXAMPLE: ACCOUNTABILITY 

USING EVALUATION DATA 



FILINGS 



"Defensive Driving" was the unit of instruction considered 
by the bus drivers as having the greatest practical value. 
The unit on "Exceptional Children" had the least value. 
All of the other units were rated as practical and useful. 

The bus drivers were in agreement with all of the atti- 
tudinal statments in the questionnaire. This was an 
indication that the "self-image" portion of the bus 
driver training was effective. 

The bus drivers were almost unanimous in their belief 
that a unit of instruction is needed on "Controlling 
Students." This appeared to be their greatest need, 
but some also requested some training in "Convoy 
Driving ." 

Interviews wit»- several school district transportation 
directors revealed general satisfaction with the program 
as administered in Region 20. Most agreed that additional 
training is required beyond the mandated course. They 
felt the course could be improved with slight modifica- 
tions such as: 

1. Reduce time spent on "Exceptional Children." 

2. Add a unit on "student discipline," or 
"driver/student relationship." 



ACTION 



Changes in the Bus Driver Training Course are the 
responsibility of the Texas Education Agency. There- 
fore, a letter summarizing the recommended improvements 
has been drafted for the Executive Director, Region 20, 
to send to the Director of School Transportation. 
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Action means concrete policv, procedures, decisions, or assignments. 
"No action" may be justified hut should be explained for the record. 

27 



4% 



CURRICULUM EXAMPLE: PROJECT MATERIALS 

USINb EVALUATION DATA 



FINDINGS 


ACTION 


A. 


A number of both resource teachers and regular 
classroom teachers encountered difficulty in 
locating materials to correspond with the project 
obj ectives. 


Project staff has expanded resource materials to assist 
teachers in locating and using appropriate materials, 
luis has included identifying objectives and resources 
for the kindergarten level, coding newly adopted 
seventh and eighth grade textbooks, and developing a 
guide for use in Special Education classes. 


B. 


Some teachers had disagreed with the sequence of 
objectives, especially in the area of multiplication. 
They believed that the objectives should be organized 
more by math concept. 


Project staff developed a guide showing teachers the 
sequence of objectives to follow if they prefer to 
organize math instruction by concept rather than by 
level. 


C. 


Management of the necessary paperwork was a problem 
reported by some teachers* 


Project staff has developed a form that covers in- 
formation needed for an Individual Education Plan, 



a progress record, and a record card. By having 
to record only once information required, the paper- 
work of Special Education teachers can be reduced. 
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Action means concrete policy, procedures, decisions, or assignments. 
"No action" may be justified but should be explained for the record. 
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CURRICULUM EXAMPLE: TEACHER TRAINING 

USING EVALUATION MTA 



FINDINGS 



The project required a team of teachers from each 
project school be trained in Infusing Reading. As 
a result, teachers of English, math, typing, and 
most other content areas attended workshops. There 
were two problems with i.his approach. 



ACTION 



Project staff will not require schools to send a team 
of teachers, but instead will allow individual teachers 
expressing an interest in the project to attend. 
Participating teachers can attend small group workshops 
tailored to individual needs and interests. 



1. Many math and vocational educational teachers 
did not see the relevance of the infjsing 
reading techniques to their content area. 

2. Project statf indicated that a number of the 
participants were familiar with some techniques 
for infusing reading prior to their attending 
the workshop. At least two teachers interviewed 
commented during their interview that they al- 
read * fund learned these techniques in college. 



B. During in; rviews, several teachers stated it was 
difficult to practice infusing reading in their 
schools without the direct support of the principal, 
other teachers in their department, or teachers of 
other con ten*" areas. 

C. More than half of teachers interviewed had not 
requested technical assistance from the project 
staff and did not anticipate requesting any in 
the future. Nevertheless, a number of teachers 
who had received assistance said this had been 
useful to them. 



Project staff will strongly encourage principals to 
become involved in the project. Staff will conduct 
on-campus visits with principals to familiarize them 
with the project and will keep principals informed of 
new developments as the project progresses. 

The project staff will again notifv first and second 
year project teachers that technical assistance is 
available to them. Workshops for third vear (1980-81) 
teachers will describe better the different types of 
technical assistance available. 
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Action means concrete policy, procedures, decisions, or assignments. 
"No action" may be justified but should be explained for the record. 
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CURRICULUM EXAMPLE: TEACHER TRAINING 

USING EVALUATION WTA 



E. 



FINDINGS 



Each workshop gave teachers several techniques and 
strategies for infusing reading. Based on data 
collected during interviews, it appeared that 
teachers were using the various techniques as 
separate units and were not coordinating individual 
components into one overall pl^n for infusing read- 
ing. 

Proiect teachers were to develop a list of reading 
skills and supporting student activities appropriate 
for their content area. Frequently, the list of 
skills was developed, but the planned student 
activities were not included. Less than one-half 
of the teachers judged this resource to be relevant 
and useful. 



ACTION 



Teachers developed activities and materials for eac'u 
separate infusing reading practice presented in the 
workshop. Next year, project staff will develop 
several related activities that will comprise one 
unit. This will enable teachers to better under- 
stand the relationship between the strategies for 
infusing reading. 

Skills for a general content area may not be 
relevant when applied to a specific text lesson 
or a specific group of children. Project staff 
believe this to be the reason why so many teachers 
did not see the lists of skills as being useful. 
Next year, project staff will provide lists of 
skills and activities previously developed. These 
should provide useful examples for future partici- 
pants. 



A.n^n .Teans concrete ;>olicv, procures, decisions, or assignments 
.Ktion" may be justified but sh.^U be explained for the record 



EXAMPLE: FUTURE DIRECTION 

USING EVALUATION DATA 



FINDINGS 



vc 



This project has just completed its third and final year 
of IV-C funding. Some findings suggest methods and 
procedures nay benefit similar projects in the future. 
For this reason, a slightly different form of the Using „ 
Evaluation Data page is used here. 

A. A needs assessment of the inservice needs of Region 20 
principals indicated that the topics of highest 
interest were ways to improve Student and Teacher 
Mo t ivat ion. 

B. Results from the Workshop Evaluation Forms indicated 
that the principals considered the region wide ses- 
sions held to be "too long". 

C. For both the region-wide conference and for the 
small gr up sessions, the principals indicated that 
they wanted more specifics presented. 



ACTION 




The principals indicated that they wanted more time 
for questions and answers and for group discussion. 



While the ratings from both the region-wide sessions 
and the large group sessions were generally good, 
the ratings for the small group sessions were 
usually higher. 
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Should any region wide conferences for principals be 
held, strong consideration should be given to having 
the agenda include the topic of Student and Teacher 
Motivation. 

Every effort should be made to insure that any region- 
wide conference for principals does not last longer 
than six hours. 

For any topic presented, what the principals appear 
to want are specific suggestions and ideas that they 
could use to become more effective. There seems to 
be minimal interest in theory or philosophy. Future 
sessions held for principals should usually focus on 
presenting specific and feasible suggestions on what 
things principals can do to be more effective. 

The principals appear to place high importance on 
being able to share with other principals. Sessions 
should usually be organized to allow 3nd encourage 
group discussion. A minimum of 20 minutes might be 
considered . 

The small group sessions appear to represent a mechanism 
to address some of the bef ore-raent ioned findings. There 
is more of an opportunity to address topics of specific 
interest, to allow group discussion, and to control the 
length of the session. Therefore, the small group or 
cluster organization appears to be a more effective 
method of meeting the needs of principals than the 
region-wide sessions. 



EXAMPLE: FUTURE DIRECTION 

USING EVALUATION DATA 



4 



FINDINGS 



O 



Since this project has just completed its third and final 
year of Title IV-C funding, some of the findings might 
best be used by identifying methods and issues that may 
affect future programs. The following are findings that 
could be generalized to other programs. Possible courses 
of actions are also discussed. 

1. The projects primary strength as judged by the 
teachers was that it helped organize instruction. 
By having the sequence of student math objectives, 
they felt better prepared in knowing what skills 
were needed and when to present them. Also, teachers 
could use the sequence to identify in what areas they 
needed to acquire additional materials. 

2. A large percentage (36%) of the teachers who were 
involved vith the project last year are no longer 
in the saiue schools this year. These teachers have 
either mov~ 1 to different schools or are no longer 
teaching «. 
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ACTION 



Well planned projects should include tools to 
assist teachers organize instruction and integrate 
information presented in workshop training. Tools 
might include a scope and sequence, a resource 
file and a plan of action. 



Two implications of teacher mobility can be listed. 
The first involves how teachers are selected for 
projects. Ideally, teachers likely to remain at 
the school who could serve as a leader and model 
for other teachers wishing to use the innovation 
should be selected. However, the actual selection 
of teachers is usually out of the hands of the 
project staff and usually done by the principals 
or supervisor. Project staff should clearly 
specify, preferably in writing, the desired 
characteristics of participants. Longevity is 
an important factor. 

Second, the high turnover of teachers should be 
kept in mind when designing materials. Materials 
designed by ESC-20 should, as much as possible, 
emphasize things teachers can carry with them or 
easily acquire. A teacher who moves to another 
school will have a difficult time continuing to 
use the project if the new school has not acquired 
a kit. 
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